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ABSTRACT 

The Philadelphia School System developed a multilevel 
Management Information Feedback System to monitor the operation of 
the reading programs of its eight subdistricts* The major steps 
involved in the developmental process were: (1) the determination of 
what information was needed; (2) the development of noninterruptive 
information collection procedures; (3) the design of useful display 
formats; (4) the writing of the required computer programs; and (5) 
the development of cooperative working relationships with all project 
personnel* District resources were coordinated and a system was 
developed which employed the district's inhouse computer facilities 
to generate information useful at the classroom^ school , and district 
administrative levelts* The project was substantially completed on 
time. Analysis of the system's output indicated that it produced 
global information which was useful for management purposes but which 
was not sufficiently individualized and skill-specific to be useful 
to the teachers at the classroom instructional level* Improvements 
were undertaken to remedy this problem* (PB) 
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The Development and Implementation of a Multl -Level Management Information 
Feedback System 

- - i rvin J» Farber 

The Impetus for our work with an Information feedback system was The 
School District of Philadelphia's Intensive effort to Improve the reading 
skills of Its students. Each of the school system^s eight administrative 
sub-dlstrlcts was given the mandate to develop reading programs appropriate 
for Its respective student populations. As may be expected > a wide range of 
programs emerged. This was Influenced by the needs of the student popula- 
tions served, the orientations of the professional staff s Involved, and, In 
some cases, the success of pub) Ishers ' representat Ives tn sounding like they 
had discovered the "phi lospher*s stone." 

Thls> In brief, was the situation that faced us. Our responsibility 
was to evaluate the progress of the reading program or, rather, programs. 
The limedlate responsibility was given to the Research Associate assigned to 
each district office, and the effort was coordinated centrally by the Research 
Office. Administrative sub-districts range in size from about 17,000 students 
to about 'iSfOOO students each, and there are approximately 35 schools In each 
district. 

The main constraints which we faced In developing the feedback system 
Included: 

1. a minimal collection effort had to produce information for three 
levels of declslon-makers! classroom, school, and upper administra- 
tion. 

2. Information produced had to be directly usable by project personnel. 
3« disruption of the Instructional process had to be minimal. 



allowance had to be made within a single system for a variety 
of programs among administrative sub-dlstrlcts. 

5. Information had to hi) available when decisions were to be made* 

6. maximum use had to be made of computer facilities so that 
teacher Involvement would be minimal. 

7. the entire Job had to be accomplished on fnhouse facilities 
(In! t lally a Oigi tek 100 and an IBM 360-^0, and currently an 
NCS Sentry 70 and an I OM 370-1^5)* 

The major steps to be accomplished in the development of the system were: 

1. determining what information was needed {i«e., who needed what? 
When? And for what purpose?) 

2. developing an Information col lection procedure that would Involve 
minimalclassroom interference. 

3. designing display formats that would report Information in a useful, 
easily understandable manner. 

writing the necessary computer programs to process and display the 
information. 

5, developing a cooperative relat ionsh i p wl th project personnel that 
would assure the utilization of the Information and a free flowback 
of reaction to It. 
While the steps listed appear to be routine and straightforward, it Is 
submitted that the final point is the critical element too of ten missing* It 
is really the interactive relationship between the evaluator and project 
personnel that transforms the evaluat Ion process from an academic exercise 
10 a process of improving the educational effort. 



The details of how each step of the system was approached will be dis- 
cussed in the subsequent papers In this symposium* 

The coordination of this effort Involved bringing together the various 
resources of the school system to produce the final products. In brief, data 
collection, transportation, scanning, data processing (l.e», report production), 
and report distribution had to be coordinated so that each element was where It 
was supposed to be, when It was supposed to be there, and Its arrival was 
expected. In addition, the actlvl ties of seven administrative sub-d I str lets 
had to be Intermeshed so that they didn't bump Into each other. This had to be 
accomplished three times during the school year. 

Appendix A Is a copy of the schedule for one month. The numbers refer to 
the administrative sub-dlstr lets . I cannot report that al 1 deadl ines were 
achieved. I can, however, testify to the fact that Edsel Murphy's law works 
beautifully! Still, before the end of the year the anticipated turnaround 
was being ach leved. 

With all of this planning and forethought one might Imagine that we had 
'•arrived.!' As one commercial has it: even your best friends won't tell you; 
Wei 1, teachers will! They found the Information produced less than useful. 
If nothing else, it was too global . The quest ion addressed by our reports 
was: what is the status of class X as of time Y? The question being asked 
by the teachers was: what shall I do wl th Johnny tomorrow morning? The 
indication was that our reports were more useful for management purposes than 
for instructional purposes. 

Teachers requi red I nformat ion about spec I f I c ski 1 Is to which they could 
oddress their Instructional programs. This meant that instruments had to be 



developed to measure these skills and the procedures outltned above 
repeated, but with one additional constraint. Classroom data becomes stale 
very quickly. We had to gear up for eventual overnight turnaround. 

This, then, Is the outline of our system addressed to each level or 
decision-maker In the school system. My col leagues wl 1 1 describe how each 
step was approached. 

I would Ifke to add one last footnote: since we submitted the outline 
for this symposium, a decision has been made to undertsike some major changes 
in our system. It will be expanded to another curriculum area, and It will 
attempt to reduce the amount of teacher Involvement by maki ng better use of 
the capabilities of our new scanning system. 

One might reasonably ask whether we are ready to share our experiences 
if our system Is not finished. I t has been our experience that a system 
begins to become obsolete as soon as it Is *'flnished.^' At this point I'm 
not sure that It will be any more "finished'' ten years from now. The critical 
need Is to be flexible enough to change and secure enough to listen when you 
are rather pointedly told that you need to do so. 
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